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Abstract — The current framework of network utility maxi- 
mization for distributed rate allocation assumes fixed channel 
code rates. However, by adapting the physical layer channel 
coding, different rate-reliability tradeoffs can be achieved on each 
link and for each end user. Consider a network where each user 
has a utility function that depends on both signal quality and data 
rate, and each link may provide a 'fatter' ('thinner') information 
'pipe' by allowing a higher (lower) decoding error probability. 
We propose two distributed, pricing-based algorithms to attain 
optimal rate-reliability tradeoff, with an interpretation that each 
user provides its willingness to pay for reliability to the network 
and the network feeds back congestion prices to users. The 
proposed algorithms converge to a tradeoff point between rate 
and reliability, which is proved to be globally optimal for codes 
with sufficiently large codeword lengths and user utilities with 
sufficiently negative curvatures. 

I. Introduction 

Since the publication of the seminal paper [1] by Kelly et 
al. in 1998, the framework of Network Utility Maximization 
(NUM) has found many applications in network rate allocation 
algorithms and Internet congestion control protocols, e.g., in 
[2], [3], [4], [5]. Consider a communication network, wireless 
or wired, with L logical links, each with a fixed capacity of 
Cf bps, and S sources (i.e., end users), each transmitting at a 
source rate of x s bps. Each source s emits one flow, using a 
fixed set L(s) of links in its path, and has a utility function 
U s (x s ). Each link I is shared by a set S(l) of sources. NUM, 
in its basic version solved by a standard distributed algorithm, 
is the following problem of maximizing the total utility of the 
network J2 S U s (x s ), over the source rates x, subject to linear 
flow constraints YlseS(l) Xs — ° l ^ or a ^ hnks I: 



seS(i) 

maximize x 
subject to 



x y o. 



< Q, V/, 



(1) 



A major limitation of formulation Q is that physical layer 
opportunities are entirely ignored. On links where physical 
layer's adaptive resource allocation can change the information 
'pipe' sizes, e.g., through power control and adaptive coding, 
each link capacity c; is no longer a fixed constant but a. function 
of resource allocation [6]. For example, changing the code 
rate on a link changes both the attainable throughput and 
decoding error probability on the link. A larger q can be 
obtained on a link at the expense of lower decoding reliability, 



which in turn lowers the end-to-end signal quality for sources 
traversing the link and reduces user utilities at those sources 
if utilities depend on both rate x s and reliability. Dynamic 
adjustment of reliability provides an additional degree of 
freedom for improving each user's utility as well as the system 
efficiency. For example, if we allow lower decoding reliability 
on more congested links and higher decoding reliability on 
less congested links, we may be able to improve end-to-end 
joint rate-reliability performance for all users. Such physical 
layer opportunities are to be leveraged in both wireless systems 
and wired networks such as DSL broadband access. However, 
the standard distributed algorithm based on congestion prices 
{e.g., [1], [4]) cannot be applied since the concept of noisy 
link and physical layer coding are absent from the basic NUM 
formulation Q. 

In this paper, we exploit the tradeoff between information 
data rate and signal reliability attained for each source, by 
controlling the code rate, or equivalently, decoding error 
probability, for each source's flow on each link and end-to-end 
information data rate of each sources' flow. As in [6], we study 
a joint transport and physical layer problem in the context of 
'layering as optimization decomposition'. In contrast to [6], 
where power control is considered at the physical layer, in this 
paper, we consider reliability of each link through error control 
coding at the physical layer. The new optimization formulation 
we propose in general has coupled and nonconvex constraints. 
Two pricing-based distributed algorithms proposed converge 
to the globally optimal rate-reliability tradeoff under certain 
sufficient conditions. Two approaches will be examined: the 
integrated dynamic reliability policy, where a link provides the 
same error probability (i.e., the same code rate) to each of the 
sources whose flows traverse it, and the differentiated dynamic 
reliability policy, where a link can provide a different error 
probability (i.e., a different code rate) to each of the sources. 

II. System model 

We assume that each source s has a utility function 
U s (x s , R s ), where x s is an information data rate and R s 
is reliability of received bits of an elastic traffic source s. 
Similar to most models based on NUM, we assume that U s is 
a smooth, increasing, and strictly concave function of x s and 
R s . Information data rate for each source s may be constrained 
within a range [x™ m ,x™ ax ], and there may be a minimum 



reliability requirement R™ m , The reliability of source s is 
defined as R s = 1 — p^ where p^ is an end-to-end error 
probability for the flow from source s. Each link / has its 
maximum transmission capacity C" lax . After link I receives 
the data of source s from the upstream link, it first decodes it 
to extract the information data and encodes it again with its 
own code rate, 77. s , where code rate is defined as the ratio of 
the information data rate x s (bps) at the input of the encoder 
to the transmission data rate ti >s (bps) at the output of the 
encoder [7]. This allows the link to adjust both transmission 
rate and error probability, since the transmission rate t[ s of 
source s at link I can be defined as 

x 8 

tl.s — 

and the error probability of source s at link I can be defined 
as a function of r/ s by 

pt, a = Ei(n,.). 

This function Ei(r^ s ) rarely has a closed-form analytic ex- 
pression, and will be approximated through known bounds. 
The end-to-end error probability for each source s is p^ = 
1 -H ei ( s )(l -Pi :S ) = l-n /ei(s) (l-£; ; (r ZiS )). Assuming 
small decoding error probability (i.e., pf s -C 1), we can 
approximate the end-to-end error probability of source s as 

Ps* E pt= E E M 

leL(s) l£L{s) 

Hence, the reliability of source s can be written as 

Since each link I has its transmission capacity C\ aax , the sum 
of transmission rates of sources that are traversing each link 
cannot exceed its transmission capacity, i.e., 



2. *«.- 

ses(i) 



E 



n, 



< cp ax , VI. 



III. Integrated dynamic reliability policy 

We first investigate a more restrictive policy where a link 
provides the same code rate to each of the sources whose flows 
traverse it, i.e., 



ri, Vs S S(l), VZ, 



and the NUM problem is formulated as 



maximize x .R. r 
subject to 



J2 s U s (x s ,R s ) 

Rs<l-EieL(s)Ei(ri), Vs 

seS(i) — - °z > v< 
xf m <x s < x™ ax , Vs 

RT m <R S <1, Vs 
< n < l, V/. 



(2) 



In order to derive a distributed algorithm to solve the above 
problem and to prove convergence to global optimum, the 
critical properties of separability and convexity of problem 
need to be carefully examined. Because of the physical 



layer coding and rate-reliability tradeoff we introduced into the 
problem formulation, these two properties no longer trivially 
hold as in the basic NUM Q- 

Integrated policy naturally leads to a decomposition of 
problem (0, since the second constraint can be written as 



J2 *s < Cr x ru VL 
ses(z) 



(3) 



The more complicated issue is convexity of function Ei(r{). 
If random coding based on Af-ary binary coded signals is used, 
an upper bound on the error probability is [8]: 

where N is the block length and i?o is the cutoff rate. Hence, 
if we take 

E l {r l )= l -2- N ^\ 

it is a convex function for given N and i?o- A more general 
approach is to use the random code ensemble error exponent 
[7] that upper bounds the decoding error probability: 

Pi <eM~NE Q ( ri )), 

where N is the codeword block length and Eo(ri) is the error 
exponent function. In general, Ei(ri) = cxp(—NEo(ri)) may 
not be convex, even though it is known [7] that Eq(ti) is a 
convex function. The following lemma provides a sufficient 
condition for convexity of E[(ri). 

Lemma 1. If the absolute value of the first derivatives of 
E (ri) is bounded away from and the absolute value of the 
second derivative of Eq(ti) is upper bounded, then for a large 
enough codeword block length N, Ei(r{) is convex. 

Proof: Assume that there exist positive constants ei and 



£2 such that 



\ dE ( n ) 
dri 



> ei and 



d A E (n) 



drf 



<e 2 . 



d 2 EAn) , , NW , 

J.2 = NcM-NE (n))(N( 



> 



NeM-NE Q (n))(Nel-e 2 ) 



dE (n) a <PE (n) 

dn 1 " 11 ' 



drf 



Hence. 



rf 2 gj(n) 
~d^ 



> for N > %. 



Throughout this paper, we assume that the conditions in the 
above lemma are true and the channel code is strong enough, 
i.e., N is large enough. In such cases, problem (0 is a convex 
and separable optimization problem, which can be solved by 
the following distributed algorithm where each source and 
each link solve their own problems only with local information 
and limited message passing. This distributed algorithm is 
derived by decomposing the dual problem of (0 (not shown 
explicitly in this summary), and we can interpret dual variables 
A; and [i s as the price per unit rate to use link / and the price 
per unit reliability that the source s must pay to the network, 
respectively. 

Algorithm 1. 



In each iteration t, by solving the following problem 1 
over (x s ,R s ), each source s determines its information data 
rate and desired reliability (i.e., x s (t) and R s (t)) that maxi- 
mize its net utility based on the prices (X s (t), [i s (t)) in the 
current iteration. Furthermore, by price update equation (|3J, 
the source offers price (j, s (t + 1) per unit reliability for the 
next iteration. 

Source problem and reliability price update at source s: 

maximize.^ A U s (x s ,R s ) - X s (t)x s - fi s (t)R s 
subject to xf m <x s < xf ax (4) 

where X s (t) = EieL(s) A *W- 

M,(t + 1) = Mt) ~ 0(t)(R s (t) - R s (t))]+, Vs, (5) 

where R s (t) = 1 — J2ieL(s) Ei{ri(t)) and [3(t) is step size, 
which can be taken as (3 /t for some /3q > 0. 

Concurrently in each iteration t, by solving problem l|6) 
over n, each link I determines its code rate (i.e., ri(t)) that 
maximizes the 'net revenue' of the network based on the prices 
in the current iteration. In addition, by price update equation 
@, the link adjusts its congestion price A;(i + 1) per unit rate 
for the next iteration. 

Link problem and congestion price update at link I: 

maximize,., Xi{t)nC] nax - n\t)Ei{n) 
subject to < n < 1, 

where /i'(t) = E se <?(*)M*)' 

Mt + l) = {Mt) - P(t)(ri(t)Cr x - x l (t))} + , VI, (7) 

where x\i) = £ seS(;) X S)- 

In the above Algorithm 1, source s needs to know X s (t), the 
sum of A;(i)'s of links that are along its path L(s). This can 
be obtained by the notification from the links e.g., through 
acknowledgment packets. To carry out price update Q, the 
source needs to know the sum of error probabilities of the 
links that are along its path (i.e., its own reliability that is 
provided by the network, R s (t)). This can be obtained by 
the notification from the links that determines the code rate 
for the source (by solving problem (|6j) or obtained by the 
notification from the destination that measures the end-to-end 
reliability. To solve the link problem 0, each link I needs to 
know [i l (t), the sum of /J s (i)'s from sources s G S(l) using 
this link /. This can be obtained by the notification from these 
sources. To carry out update 0, the link needs to know the 
aggregate information data rate of the sources that are using it 
(i.e., x l (t)). This can be obtained by measuring it by the link 
itself. 

With dual decomposition and Lemma 1, the following result 
can be proved using standard techniques in distributed gradient 
algorithm's convergence proof: 

'Optimization problems J4} and J6} (also problems II II and 1 1 31 in 

Algorithm 2) are convex optimization in only one or two variables with 
simple range constraints. Hence, they can be easily solved by using standard 
algorithms such as a gradient projection algorithm. 



Theorem 1. By Algorithm 1, dual variables X(t) and fi(t) 
converge to the optimal dual solutions A* and /x* and the 
corresponding primal variables x*, R*, and r* are the globally 
optimal primal solutions of (0. 

IV. Differentiated dynamic reliability policy 

In this policy, a link may provide a different code rate to 
each of the sources traversing it. An example of practical code 
constructions that enable such a flexibility is the coding tech- 
nique with embedded diversity recently proposed in [9], which 
allows data streams with different rate-reliability tradeoffs be 
embedded within each other. 

The problem formulation in (|2) needs to be generalized to 
the following: 

maximize X! R !r £ s U s (x s , R s ) 

subject to R s < 1 - J2ieL(s) E l( r l,s), Vs 

xf m <x s < x™ ax , V.s 

R rnin < Rg < ^ y g 

o < n <s < 1, VZ, S £ S(l). 

The objective function and constraints of problem l|8} are the 
same as those of problem (0 except that we have r/. s here 
instead of 7-/. Due to this critical difference, problem (|SJl in 
general is neither a convex problem nor a separable one (since 
we may not modify the second constraint in this problem 
as in (|3})- To resolve this issue, we transform problem © 
by first introducing the auxiliary variables q. s , which can be 
interpreted as the allocated transmission capacity to source s 
at link I. Then, the above problem can be reformulated as 

mazimize XiRiI . ^ s U s (x s , R s ) 
subject to R s < 1 - Y,ieL(s) E i( r is), Vs 
£ < Q, s , VZ, s e S(l) 

ses(z) c ^ s — °i ' vt (9) 
xf in <x s < xf ax , Vs 

R min <R S <1 } Vs 

< n, s < 1, VI, s S S(l) 
< ci,, < C\ nax , VI, s e S(l). 

The second constraint in problem (|8jl is now decomposed 
into two constraints in problem (|9ji: the second and third 
constraints. Here, the second constraint implies that the trans- 
mission data rate of each source at each link must be smaller 
than or equal to its allocated transmission capacity at the link, 
and the third constraint implies that the aggregate allocated 
transmission capacity to the sources at each link must be 
smaller than or equal to its maximum transmission capacity. In 
this formulation, each link explicitly allocates a transmission 
capacity to each of its sources. We can easily show that 
problem (|9jl is equivalent to problem (|8jl, since at optimality, 
the second constraint in problem (|9jl is satisfied with the 
equality. 

The next step of problem transformation is to take a log 
change of variable at the second constraint in problem (|9jl 



and set x' s — \ogx s {i.e., x s — e Xs ). This reformulation turns 
problem into the following equivalent problem: 

maximize^ iR , r!C J2 s U 's( x 's> R s) 

subject to R s < 1 - J2ieL(s) E l( r l,s), Vs 

x ' s ~ logn, s < \ogc^ s , VZ, s S 5(Z) 



R™ m <R S <1, Vs 

< n,. < 1, V/, s g 5(Z) 

< Q. s < Cf V/, i € 5(0, 

(10) 

where U' s (x' s ,R s ) = U s (e<,R s ) and a;™" = log a;™" and 

™ mas 1^,^ 'max 

X s — iugj, s 

Note that problem (II Oi is separable but still may not be a 
convex optimization problem since the objective U' s (x' s ,R s ) 
may not be a concave function, even though U s (x s ,R s ) is a 
concave function. The following lemma provides a sufficient 
condition for its concavity. For notational simplicity, assume 
that U s (x s ,R s ) is additive in each variable (the general case 
is an easy extension), U s (x s ,R s ) — U x (x s ) + U^(R S ) (i.e., 
U' s (x' s ,R s ) = Uf'{x' s ) + U?(R„)), and U*(R a ) be a strictly 
concave function of R s . Define 

d 2 U x (x s ) ^dU x (x s ) 

g s (x B ) = — — — x s + 



dx 2 



dx s 



Lemma 2. If g s (x s ) < 0, U x (x' s ) is a concave function of 
x' g and U' s (x' s ,R s ) is a concave function of x' a and R s . 
Proof: Since x s — e x °, 

2 



d 2 U x s {x' s ) = d 2 U x (x s ) fdx, 
dx' s 2 dx 2 s \ dx' s 

d 2 U*(x s ) i 
dx 2 

B 9s(Xs). 



dU x (x s ) d x s 
dx s dx' 2 

du x (x s y 

dx„ 



Hence, if g s (x s ) < 0, U x (x' s ) is a concave function of x' s 
The condition of g s (x s ) < is equivalent to: 

d 2 U x (x s ) ^ dU x {x s ) 



dx 2 



< 



x s dx s 



Since utility functions are increasing, dU ^ Xs ^ is a positive 
number. The above inequality states that the utility function 
needs to be not just concave (i.e., — ^ " < 0), but with a 
curvature that is bounded away from by as much as ^LLSeA 

J J x s dx s ' 

i.e., the user utility function must be 'elastic' enough. 
For example, consider the often-used utility functions [5]: 



U7{x s ) 



log x a , if a = 1 

(1 — a)~ 1 x 1 a ~ a , otherwise 



For this family of utility functions parameterized by a, Lemma 
2 shows that problem dlOt becomes a convex optimization 
problem if a > 1. 

After the above procedures of problem transformations, 
we are ready to provide a distributed algorithm based on 
dual decomposition to solve problem i ll Oi l, and to prove the 



performance guarantee on global optimality provided that the 
conditions in Lemmas 1 and 2 hold. 
Algorithm 2. 

Equations are now replaced by ( II H - dl4t . In con- 

trast to Algorithm 1 that does not keep per-flow information 
on the links, in the more complex Algorithm 2, each link 
differentiates each of the flows through it by providing a 
different code rate r/ )S , a different congestion price A/ s , and 
an explicit capacity allocation c/. s . In addition, the congestion 
price Aj, s is determined based on the allocated capacity q iS 
and the transmission rate x s /ri, s of each individual source 
that uses link I in Algorithm 2, while the congestion price 
Az is determined based on the aggregate transmission rate of 
sources that use link I and the transmission capacity of the 
link in Algorithm 1. 

Source problem and reliability price update at source s: 

mazimize. T / A U s (x' s ,Rs) - ^ s (t)x' s - Hi(t)R s 
subject to x' s mm < x's < x' s max (11) 
R min < i? s < l ; 

where X s (t) = J2iel( s ) \s(t). 

H 3 (t + 1) = [ Ms (i) - P(t)(R s (t) - R s (t))} + , Vs, (12) 

where R s (X(t), M (t)) - 1 - £ ieL(s ) ^(n, s (A(t), M (t)). 
Link problem and congestion price update at link I: 

maxirnize n siC , si s es(i) E se s(!){ A ^(i)(k>gQ, s + logn, s ) 
subject to £ se s(0 %. < C? ax 



< c Us < Cl nax , s e S(l) 
0<n' s <l, seS(l). 



(13) 



\ s (t + 1) = [A,,,(t) - ^(t)(logc M (t) + logn >s (t) - x' s (t))}+ 
Vl,seS(l). (14) 

Theorem 2. By Algorithm 2, dual variables X(t) and fi(i) 
converge to the optimal dual solutions A* and /x* and the 
corresponding primal variables x *, R*, c*, and r* are the 
globally optimal primal solutions of problem (I10i . 

Extensions of Algorithms 1 and 2 to asynchronous version 
with constant step size can be carried out similar to those in 
[6]. 

V. Numerical examples 



U1 and U2 + 

Fig. 1 . Network topology and flow routes for rate-reliability tradeoff example. 



We present numerical examples for a simple network shown 
in Figure [0 Utility function U s (x s ,R s ) for user s has the 



Fig. 2. Globally optimal rate-reliability tradeoff of 3 of the end users, using 
the integrated dynamic reliability policy (Algorithm 1). 



Fig. 3. Comparison of the achieved network utility attained by each policy. 



following standard form of concave utility: 

„l—a _ min(l-a) 

U ( R ) 

D (l — a) D mm(l — a) 

id ri s -U s 

+ {J — a s ) jz r —7- r. 

D maa:(l — a) D mm(l- a) 
its ~ Us 

where a s is a constant (0 < a s < 1) that determines the 
relative weight between rate and reliability. The decoding error 
probability on each link I is assumed to be the following form: 
pf = \ cxp(— N(l — 77)) where N is the channel code block 
length and 77 the code rate for link I. We set a = 1.1, x" lm = 

0. 1 (Mbps), x™ ax = 2 (Mbps), C\ nax = 2 (Mbps), R™ ax = 1, 
and RJ 1 in = 0.9. 

We trace the globally optimal tradeoff curve between rate 
and reliability, and also compare the total network utility 
achieved by the following three policies: 

• Static reliability 

> Integrated dynamic reliability 

• Differentiated dynamic reliability. 

In the static scheme, each link provides a fixed error proba- 
bility 0.025 and rate is allocated to each user by solving the 
basic NUM problem 

We first investigate the case where all the users have the 
same a s = a, and vary the value of a from to 1 in step size 
of 0.1. The resulting tradeoff curve obtained by Algorithm 1, 
which is globally optimal, is shown in Figure |2] As expected, 
a larger a (i.e., utility from rate given a heavier weight) leads 
to a higher rate at the expense of lower reliability. The more 
congested links a user's flow passes through, the steeper the 
tradeoff curve becomes. For each user, the area to the left 
and below of the tradeoff curve is the achievable region, and 
the area to the right and above of the tradeoff curve is the 
infeasible region. It is impossible to operate in the infeasible 
region and inferior to operate in the interior of the achievable 
region. Operating on the boundary of the achievable region, 

1. e., the Pareto optimal tradeoff curve, is the best. 

We then give different weights a s to the eight users: 

J 0.5 — v, if s is an odd number 
s I 0.5 + ti, if s is an even number 

and vary v from to 0.5 in step size of 0.05. Figure [3] 
shows the relative performance in terms of network utility 



achieved by the three policies as v changes. The performance 
of Algorithms 1 and 2 that take into account rate-reliability 
tradeoff is significantly better than the standard distributed 
algorithm for the basic NUM Q that ignores the possibility 
of jointly optimizing rate and reliability. 

VI. Concluding Remarks 

Motivated by needs from the application layer and pos- 
sibilities at the physical layer, this paper removes the rate- 
dependency assumption on utility functions in the current 
NUM formulation and allows the physical layer adaptive 
channel coding to tradeoff rate and reliability on each link and 
for all the sources. We present two distributed algorithms for 
two possible formulations of the problem, and provide the suf- 
ficient conditions on codeword length and utility curvature un- 
der which convergence to the globally optimal rate-reliability 
tradeoff can be proved. In addition to link-updated congestion 
prices for distributed rate control, we also introduce source- 
updated signal quality prices for distributed reliability control. 
The tradeoff between packet drop probability and traffic load 
may be investigated similar to that between decoding error 
probability and transmission rate examined in this paper. 
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